Survey: Transformer based video-language pre-training

Inspired by the success of transformer-based pre-training methods on natural language tasks and further computer vision tasks, researchers have started to apply transformer video processing. This survey aims provide a comprehensive overview for Video-Language learning. We first briefly introduce structure as background knowledge, including attention mechanism, position encoding etc. then describe typical paradigm & fine-tuning processing in terms proxy downstream commonly used datasets. Next, we categorize models into Single-Stream Multi-Stream structures, highlight their innovations compare performances. Finally, analyze discuss current challenges possible future research directions pre-training.